Content processing apparatus, content processing method, and storage medium

ABSTRACT

Value-added information is created based on favorite information of a content user. The content is processed according to the generated value-added information. Favorite data indicating operations, such as fast-forward, pause, and rewind operations, performed while the content is being played back, and personal user information, such as the age group, the gender, and the life-style, of the content user are transferred to a server via a network. The server performs statistical processing on the user favorite data to generate value-added information according to the attributes of the user, such as the age group, the gender, and the life-style. Accordingly, the user is able to search for popular titles, play back only popular scenes, and skip uninteresting scenes by using a content playback apparatus.

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention generally relates to a content processingapparatus and a content processing method for processing content to bedistributed or delivered via various distributing/delivering means, andalso to a storage medium implementing such a method. More particularly,the invention pertains to a content processing apparatus and a contentprocessing method for processing value-added information for thecontent, and also to a storage medium implementing such a method. Morespecifically, the invention relates to a content processing apparatusand a content processing method for processing content digestinformation obtained from favorite information of a content user orinstruction information for playing back the content, and also to astorage medium implementing such a method. More particularly, theinvention relates to a content processing apparatus and a contentprocessing method for processing the content according to the contentdigest information, and also to a storage medium implementing such amethod.

[0003] 2. Description of the Related Art

[0004] Various types of content, such as movies, dramas, sport programs,music, etc., are now distributed or delivered to many unspecifiedviewers/listeners (users) via various distributing/delivering means,such as distributing via broadcast or communication, and delivering viamedia, for example, digital versatile discs (DVDs) on which the contentis stored.

[0005] In this type of content distributing/delivering technique, thecontent is simply distributed/delivered from a content provider, and theuser favorite information is not added to the content. For example, whenplaying back the content with a playback apparatus, the user may find apopular title, an interesting scene, and an uninteresting scene in thecontent. The user expresses his/her favorite in response to such variousscenes by performing an operation on the playback apparatus, forexample, changing channels, fast-forwarding the content, or rewindingthe content.

[0006] The favorite data obtained by the above-described user operationis very useful in selecting the content from an enormous number of itemsof content, and has predetermined added value. The user favorite datacan also be used for classifying and digesting the content, such asselecting a specific title or a specific scene from the title andstoring it (or recording an index of the selected scenes).

[0007] At present, however, a system for feeding back such an addedvalue obtained from the user favorite information to the user, or asystem for utilizing the added value for viewing/listening to thecontent is not provided.

SUMMARY OF THE INVENTION

[0008] Accordingly, it is an object of the present invention to providea content processing apparatus and a content processing method forprocessing content digest information for providing an added value, andalso to a storage medium implementing such a method.

[0009] It is another object of the present invention to provide acontent processing apparatus and a content processing method forprocessing content digest information obtained from user favoriteinformation and content instruction information, and also to a storagemedium implementing such a method.

[0010] It is still another object of the present invention to provide acontent processing apparatus and a content processing method forprocessing the content according to content digest information, and alsoto a storage medium implementing such a method.

[0011] In order to achieve the above objects, according to one aspect ofthe present invention, there is provided a communication apparatusincluding a receiver for receiving operation data obtained by each userfor dynamic data played back by a playback apparatus. A storage unitstores the operation data received by the receiver. A digest-informationgenerator generates digest information of the dynamic data according tothe operation data stored in the storage unit. A transmitter transmitsthe digest information generated by the digest-information generator toat least one of the playback apparatuses.

[0012] In the aforementioned communication apparatus, the receiver mayreceive the operation data indicating at least one of instructions tofast-forward, rewind, and pause the dynamic data played back by theplayback apparatus.

[0013] The receiver may receive playback-portion identificationinformation indicating a playback portion of the dynamic data playedback by the playback apparatus. The digest-information generator mayinclude a statistical processor for accumulating playback times of theplayback portion based on the playback-portion identificationinformation received by the receiver, in which case, thedigest-information generator generates the digest information based onan accumulation result obtained by the statistical processor.

[0014] The digest-information generator may generate the digestinformation from the playback portion whose accumulated playback timesindicate a predetermined threshold or greater.

[0015] The digest-information generator may generate the digestinformation from the portions other than the playback portion whoseaccumulated playback times indicate a predetermined threshold orsmaller.

[0016] The receiver may receive, together with the operation data, atleast one of title information, playback time information, and userattribute information of the dynamic data played back by the playbackapparatus.

[0017] The storage unit may store the operation data of a plurality ofusers corresponding to the title information. The statistical processormay accumulate the playback times of the playback portion according tothe title information based on the operation data of the plurality ofusers. The digest-information generator may generate the digestinformation based on the accumulation result. The transmitter maytransmit the digest information to the playback apparatus for playingback the title information.

[0018] The user attribute information may include at least one type ofthe age, the gender, and the life-style, in which case, thedigest-information generator may generate the digest informationaccording to the type of the user attribute information.

[0019] The receiver may receive as the operation data time-spaceposition data designating a time-space position of the dynamic dataplayed back by the playback apparatus.

[0020] The storage unit may store a plurality of the dynamic data. Thetransmitter may encode the dynamic data and transmit the encoded dynamicdata to the playback apparatus in response to a request from the user,in which case, the transmitter may encode a target area designated bythe time-space position data at a first resolution level, and may encodeareas other than the target area at a second resolution level which islower than the first resolution level.

[0021] The transmitter may transmit predetermined dynamic data to theplayback apparatus in response to a request from the user. The receivermay receive the operation data obtained by each user for the dynamicdata transmitted by the transmitter. The digest-information generatormay generate the digest information of the dynamic data according to theoperation data. The transmitter may transmit the generated digestinformation to the corresponding playback apparatus in response to arequest from the user.

[0022] The transmitter may include a broadcast unit for broadcasting thedynamic data to the playback apparatuses of unspecified users.

[0023] The receiver may receive as the operation data time-spaceposition data designating a time-space position of the dynamic datatransmitted by the transmitter and played back by the playbackapparatus.

[0024] The transmitter may encode the dynamic data and transmit theencoded dynamic data to the playback apparatus in response to a requestfrom the user, in which case, the transmitter may encode a target areadesignated by the time-space position data at a first resolution level,and encode areas other than the target area at a second resolution levelwhich is lower than the first resolution level, and may transmit theencoded dynamic data.

[0025] The digest-information generator may include a statisticalprocessor for accumulating designation times of each of the time-spacepositions based on the time-space position data of the identical dynamicdata received from a plurality of users by the receiver, and maygenerate the digest information based on an accumulation result obtainedby the statistical processor.

[0026] The digest-information generator may dynamically sort theaccumulation results of scenes designated by the time-space positiondata obtained by the statistical processor in descending numeric order,and may extract a predetermined number of scenes having a greater numberof the accumulated designation times according to a sorting result,thereby dynamically generating the digest information.

[0027] The transmitter may include a broadcast unit for broadcasting thedynamic data to the playback apparatuses of unspecified users. When thereceiver receives request information to send the digest informationfrom the playback apparatus while the dynamic data is being broadcast,the digest-information generator may generate the digest informationduring a period from when the dynamic data is started until when thedigest information is transmitted. The transmitter may transmit thedigest information to the playback apparatus.

[0028] When the receiver receives request information to send the digestinformation from a specific playback apparatus, the digest-informationgenerator may compare the digest information generated based on thesorting result with the scenes designated by the time-space positiondata of the user of the specific playback apparatus, and maypreferentially select the scenes unique to the time-space position dataof the user, thereby generating new digest information for the user.

[0029] The transmitter may transmit the digest information to theplayback apparatus of the user, and may also transmit accountinginformation including payment information for billing the user to anexternal settlement center.

[0030] According to another aspect of the present invention, there isprovided a communication apparatus including a playback unit for playingback dynamic data. An input unit inputs as input data user favorite datafor the dynamic data played back by the playback unit. A transmittertransmits the input data input by the input unit to an externalcommunication apparatus. A receiver receives digest information of thedynamic data transmitted from the external communication apparatus.

[0031] In the aforementioned aspect of the communication apparatus, theinput unit may output the input data indicating at least one ofinstructions to fast-forward, rewind, and pause the dynamic data playedback by the playback unit.

[0032] The transmitter may transmit playback-portion identificationinformation indicating a playback portion of the dynamic data playedback by the playback unit.

[0033] The transmitter may transmit, together with the input data, atleast one of title information, playback time information, and userattribute information of the dynamic data played back by the playbackunit.

[0034] The input unit may output as the input data time-space positiondata designating a time-space position of the dynamic data played backby the playback unit. The transmitter may transmit the time-spaceposition data.

[0035] The transmitter may transmit request information to sendpredetermined dynamic data to the external communication apparatus. Thereceiver may receive the dynamic data transmitted from the externalcommunication apparatus in response to the request information. Theplayback unit may play back the received dynamic data.

[0036] The receiver may include a broadcast receiver for receiving thedynamic data to be broadcast to the playback unit of unspecified users.

[0037] The transmitter may transmit as the input data time-spaceposition data designating a time-space position of the dynamic datareceived by the receiving unit and played back by the playback unit.

[0038] The transmitter may transmit the request information to send thedigest information during a period from the start of the dynamic datauntil a current time while the dynamic data is being played back by theplayback unit.

[0039] According to still another aspect of the present invention, thereis provided a communication apparatus including a receiver for receivingdynamic data from an external source. A playback unit plays back thedynamic data received by the receiver. An input unit inputs as inputdata user favorite data for the dynamic data played back by the playbackunit. A digest-information generator generates digest information basedon the input data input by the input unit. A transmitter transmits thedigest information generated by the digest-information generator to aportable terminal.

[0040] In the aforementioned aspect of the communication apparatus, theinput unit may output input data indicating at least one of instructionsto fast-forward, rewind, and pause the dynamic data played back by theplayback unit.

[0041] The input unit may output as the input data playback-portionidentification information indicating a playback portion of the dynamicdata played back by the playback unit. A digest-information generatormay include a statistical processor for accumulating playback times ofthe playback portion based on the playback-portion identificationinformation, in which case, the digest-information generator generatesthe digest information based on an accumulation result obtained by thestatistical processor.

[0042] The digest-information generator may generate the digestinformation from the playback portion whose accumulated playback timesindicate a predetermined threshold or greater.

[0043] The digest-information generator may generate the digestinformation from portions other than the playback portion whoseaccumulated playback times indicate a predetermined threshold orsmaller.

[0044] The input unit may output as the input data at least one of titleinformation, playback time information, and user attribute informationof the dynamic data played back by the playback unit.

[0045] The aforementioned aspect of the communication apparatus mayfurther include a storage unit for storing the operation data of aplurality of users corresponding to the title information. In this case,the statistical processor may accumulate the playback times of each ofthe playback portions according to the title information based on theoperation data of the plurality of users, and the digest-informationgenerator may generate the digest information based on the accumulationresult.

[0046] The user attribute information may include at least one type ofthe age, the gender, and the life-style, in which case, thedigest-information generator may generate the digest informationaccording to the type of the user attribute information.

[0047] The input unit may output as the input data time-space positiondata designating a time-space position of the dynamic data played backthe playback unit.

[0048] The transmitter may transmit request information to sendpredetermined dynamic data to an external communication apparatus. Thereceiver may receive the dynamic data transmitted from the externalcommunication apparatus in response to the request information. Thedigest-information generator may generate the digest information of thedynamic data.

[0049] The receiver may include a broadcast receiver for receiving thedynamic data to be broadcast to the playback unit of unspecified users.

[0050] The input unit may output as the input data time-space positiondata designating a time-space position of the dynamic data received bythe broadcast receiver and played back by the playback unit.

[0051] The digest-information generator may include a statisticalprocessor for accumulating designation times of each of the time-spacepositions based on the time-space position data of the identical dynamicdata input by the input unit, in which case, the digest-informationgenerator may generate the digest information based on an accumulationresult obtained by the statistical processor.

[0052] The digest-information generator may dynamically sort theaccumulation results of scenes designated by the time-space positiondata obtained by the statistical processor in descending numeric order,and may extract a predetermined number of scenes having a greater numberof the accumulated designation times according to a sorting result,thereby dynamically generating the digest information.

[0053] When the input unit outputs request information to send thedigest information from the playback unit while the dynamic data isbeing broadcast, the digest-information generator may generate thedigest information during a period from when the dynamic data is starteduntil when the digest information is transmitted.

[0054] When the input unit outputs request information to send thedigest information from a specific user, the digest-informationgenerator may compare the digest information generated based on thesorting result with the scenes designated by the time-space positiondata of the specific user, and may preferentially select the scenesunique to the time-space position data of the specific user, therebygenerating new digest information for the specific user.

[0055] The transmitter may preferentially transmit the digestinformation to the portable terminal according to the level of priorityor the level of urgency of the digest information.

[0056] The digest-information generator may generate the digestinformation in a hierarchical structure consisting of layers havingdifferent sizes of the digest information, in which case, a lower layerof the hierarchical structure may have a greater size of the digestinformation, and a higher layer of the hierarchical structure may have asmaller size of the digest information.

[0057] The digest-information generator may selectively transmit thedigest information of the individual levels of the hierarchicalstructure according to a traffic of a communication channel between thecommunication apparatus and the portable terminal.

[0058] The playback unit may include a display unit for displayingmoving picture data, which serves as the dynamic data or the digestinformation.

[0059] According to a further aspect of the present invention, there isprovided a communication method including the steps of: receivingoperation data obtained by each user for dynamic data played back by aplayback apparatus; generating digest information of the dynamic dataaccording to the received operation data; and transmitting the generateddigest information to at least one of the playback apparatuses.

[0060] According to a yet further aspect of the present invention, thereis provided a communication method including the steps of: playing backdynamic data; inputting as input data user favorite data for the playedback dynamic data; transmitting the input data to an externalcommunication apparatus; and receiving digest information of the dynamicdata transmitted from the external communication apparatus.

[0061] According to a further aspect of the present invention, there isprovided a communication method including: receiving dynamic data froman external source; playing back the received dynamic data; inputting asinput data user favorite data for the played back dynamic data;generating digest information based on the input data; and transmittingthe generated digest information to a portable terminal.

[0062] According to a further aspect of the present invention, there isprovided a storage medium for storing a program implementing acommunication method. The communication method includes the steps of:receiving operation data obtained by each user for dynamic data playedback by a playback apparatus; generating digest information of thedynamic data according to the received operation data; and transmittingthe generated digest information to at least one of the playbackapparatuses.

[0063] According to a further aspect of the present invention, there isprovided a storage medium for storing a program implementing acommunication method. The communication method includes the steps of:playing back dynamic data; inputting as input data user favorite datafor the played back dynamic data; transmitting the input data to anexternal communication apparatus; and receiving digest information ofthe dynamic data transmitted from the external communication apparatus.

[0064] According to a further aspect of the present invention, there isprovided a storage medium for storing a program implementing acommunication method. The communication method includes the steps of:receiving dynamic data from an external source; playing back thereceived dynamic data; inputting as input data user favorite data forthe played back dynamic data; generating digest information based on theinput data; and transmitting the generated digest information to aportable terminal.

[0065] The above-described storage media provide computer programs togeneral-purpose computer systems which execute various program codes.Such media include detachable and portable storage media, for example,compact discs (CD), floppy disks (FD), magneto-optical disks (MO), etc.It is also technically possible to provide the computer programs to aspecific computer system via a transmission medium, such as a network(may be a wireless or cable network).

[0066] In the above-described storage media, structural or functionalcooperative relationships between a predetermined computer program andthe storage medium for implementing the functions of the computerprogram in a computer system are defined. In other words, by installinga predetermined computer program into a computer system via one of theabove-described storage media of the present invention, the cooperativeaction can be exerted on the computer system. In this case, advantagessimilar to those offered by the communication apparatuses or thecommunication methods of the present invention can be obtained.

[0067] According to the above-described communication apparatuses, thecommunication methods, and the storage media of the present invention,it is possible to obtain user operation information, such asfast-forward, pause, and rewind operations, performed when the content,such as video or music, stored in a medium, such as a DVD, is playedback in a predetermined content playback apparatus. Then, the operationinformation of a plurality of users is centrally processed by apredetermined server so as to generate value-added informationincluding, for example, popular titles, interesting scenes, anduninteresting scenes. The value-added information can be distributed tothe users, in which case, it may be charged to the user. Upon receivingthe value-added information, the user is able to search for populartitles, play back only the interesting scenes, or skip the uninterestingscenes by using the content playback apparatus. In this case, thevalue-added information can be created while being transparent to theuser.

[0068] In addition to the user operation information, personal userinformation and the playback-time-zone information can also be sent tothe server. In this case, the server is able to generate value-addedinformation according to the type of user attributes, such as the agegroup, the gender, and the life-style. Thus, it is possible to providethe value-added information suitable for the user requesting thevalue-added information. The user is thus able to select the contentplayback technique suitable for the user.

[0069] According to the present invention, when the content of atime-based event (for example, a movie, a drama, or a sport program) isdistributed or played back, predetermined statistical processing isperformed by centrally processing instruction information for temporallyor spatially specifying favorite scenes by a predetermined server.Accordingly, digest scenes consisting of scenes that the user wishes toview can automatically be created. The digest scenes can be dynamicallyupdated by continuously receiving the instruction information. Forexample, for the viewers who have started to watch an event half waythrough, a digest scene indicating the past progress of the event can beprovided, which can be a guide for the users. The created digest scenesmay be charged to the users.

[0070] Additionally, according to the present invention, by performingthe statistical processing as discussed above, an averaged digestreflecting the favorites of many users can be created. The createdaveraged digest can be charged to the users.

[0071] The favorite information of a specific user has portions whichoverlap with the averaged digest and portions which do not overlaptherewith. Thus, a personal digest can be created by emphasizing theportions unique to the favorite information of the specific user, whichreflects the difference of the favorites between the user and the otherusers. The personal digest can also be charged to the users.

[0072] According to the present invention, upon receiving the content ofa time-based event, a content receiving apparatus is able to not onlyplay back the content, but also digest the content, and distribute thecontent digest to a small portable receiving terminal, such as apersonal digital assistant (PDA). As a result, the portable receivingterminal is able to play back the content digest under a mobileenvironment without a content receiving function or a content digestingfunction.

[0073] When sending the content or the content digest from the contentreceiving apparatus to a portable receiving terminal, informationindicating the priority or the urgency of the content can be added.Accordingly, the content or the digest having a high level of priorityor urgency can automatically be sent to the receiving terminal. Also, adigest can be formed into a hierarchical structure consisting of layershaving different amount of information. Then, the digest of a suitablelevel of the hierarchical structure can efficiently be transmittedaccording to the traffic between the receiving apparatus and thereceiving terminal, the communication time, or the storage capacity ofthe receiving terminal.

[0074] Further objects, features and advantages of the present inventionwill become apparent from the following description of the preferredembodiments with reference to the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

[0075]FIG. 1 is a schematic diagram illustrating the configuration of anetwork system 10 according to an embodiment of the present invention;

[0076]FIG. 2 is a block diagram illustrating the functionalconfiguration of a content playback apparatus 20 and a server 30 shownin FIG. 1;

[0077]FIG. 3 is a flow chart illustrating the processing executed by thecontent playback apparatus 20;

[0078]FIG. 4 is a flow chart illustrating the processing executed by theserver 30;

[0079]FIG. 5 is a schematic block diagram illustrating the hardwareconfiguration of a DVD player 50 used as the content playback apparatus20;

[0080]FIG. 6 illustrates an example of the recording format of a DVD;

[0081]FIG. 7 schematically illustrates the program chain (PGC) structuredefined by DVD-VIDEO standards;

[0082]FIG. 8 is a flow chart illustrating the processing executed by theDVD player 50 as a client;

[0083]FIG. 9 is a flow chart illustrating the processing executed by theserver 30 for providing value-added information services to each DVDplayer;

[0084]FIG. 10 is a flow chart illustrating the processing for creatingvalue-added information executed by the server 30 shown in FIG. 1;

[0085]FIG. 11 schematically illustrates a result obtained by computingthe content playback information of the users input from the individualDVD players;

[0086]FIG. 12 illustrates an example of the configuration of avalue-added information database;

[0087]FIG. 13 illustrates a result obtained by accumulatively adding theplayback Video Object Set (VOB) ID numbers and the playback cell IDnumbers;

[0088]FIG. 14 is a schematic diagram illustrating the configuration of anetwork system 110 according to another embodiment of the presentinvention;

[0089]FIG. 15 is a block diagram illustrating the functionalconfiguration of a client 120 and a server 130 shown in FIG. 14;

[0090]FIG. 16 is a flow chart illustrating the processing executed bythe client 120 and the server 130 when regular content distributionprocessing is performed;

[0091]FIG. 17 is a flow chart illustrating the processing for creating adynamic digest scene;

[0092]FIG. 18 is a histogram for extracting digest scenes;

[0093]FIG. 19 is a digest table in which candidates to be extracted asdigest scenes are listed;

[0094]FIG. 20 is a flow chart illustrating the processing fordistributing digest information by the client 120 and the server 130;

[0095]FIG. 21 is a schematic diagram illustrating the configuration of anetwork system 210 according to still another embodiment of the presentinvention;

[0096]FIG. 22 is a block diagram illustrating the functionalconfiguration of a client 220 and a content distribution server 230shown in FIG. 21;

[0097]FIG. 23 is a flow chart illustrating the overall processingexecuted between the client 220 and the content distribution server 230;

[0098]FIG. 24 is a flow chart illustrating the processing for creatingan averaged digest by the content distribution server 230;

[0099]FIG. 25 is a flow chart illustrating the processing for creating apersonal digest by the content distribution server 230;

[0100]FIG. 26 is a schematic diagram illustrating the configuration of acontent distribution system 300 according to a further embodiment of thepresent invention;

[0101]FIG. 27 is a block diagram illustrating the functionalconfiguration of a content receiving apparatus 350 applied to theembodiment shown in FIG. 26;

[0102]FIG. 28 is a flow chart illustrating content digesting processingexecuted by the content receiving apparatus 350; and

[0103]FIG. 29 is a schematic block diagram illustrating theconfiguration of a computer system 500 for performing contentdistribution processing and value-added information creation processing.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0104] The present invention is described in detail below with referenceto the drawings through illustration of preferred embodiments.

[0105]FIG. 1 schematically illustrates the configuration of a networksystem 10 according to an embodiment of the present invention. Thenetwork system 10 is formed of, as shown in FIG. 1, content playbackapparatuses 20A, 20B, and so on (hereinafter simply referred to the“playback apparatus 20” unless it is necessary to distinguish themindividually), for playing back the content stored in a medium, such asa DVD, a server 30 for generating content digest information based onuser favorite data obtained from the user of the content playbackapparatus 20, i.e., the content viewer/listener, and an accountingserver 40 for performing accounting processing for the distribution ordelivering of the digest information.

[0106] In this embodiment, the user favorite data is formed ofinformation of the operations performed by the user while playing backthe content (for example, the operation history, such as fast-forward,pause, rewind, etc., on the content playback apparatus 20). The userfavorite data, and personal user information, such as the age group, thegender, and the life-style, are transferred to the server 30 via anetwork.

[0107] The server 30 then applies predetermined computation processingto the user favorite data so as to generate value-added information asthe content digest information according to the user attributes, such asthe age group, the gender, and the life-style. The value-addedinformation is distributed to the individual content playbackapparatuses 20A, 20B, and so on, i.e., to the content users (viewers andlisteners). In this case, the user may be charged for the content andthe value-added information, or the user may receive them free.

[0108]FIG. 2 is a block diagram illustrating the functionalconfiguration of the content playback apparatus 20 as a client, and theserver 30.

[0109] The content playback apparatus 20 includes, as shown in FIG. 2, acentral processing unit (CPU) 21, a transmitter/receiver 22, a mediareader 23, an operation information interface 24, an informationprovider 25, a transmitting-information encoder 26, areceived-information decoder 27, and a storage unit 28. Under theoverall control of the CPU 21, the content playback apparatus 20 playsback the content, and performs the accompanying processing operation,for example, playing back the value-added information.

[0110] The media reader 23 accesses the recording surface of a mediumloaded in a media accommodating portion, such as a tray, to read thecontent, and supplies it to the information provider 25.

[0111] The information provider 25, which is formed of an image outputdevice, such as a display device, and an audio output device, such as aspeaker, plays back (output) the content read by the media reader 23.

[0112] The content reading operation by the media reader 23 and theoutput operation by the information provider 25 are basically performedin response to a user operation performed via the operation informationinterface 24. The operation information interface 24 includes operationbuttons, such as play, stop, fast-forward, and rewind buttons.

[0113] The user operation information input by the user via theoperation information interface 24 forms the user favorite data of thecontent played back by the user. The user operation information isoutput to the transmitting-information encoder 26 as material data forgenerating the content digest information. The transmitting-informationencoder 26 performs a predetermined encoding operation on part of thetransmitting information, and more specifically, on title information ofthe content read by the media reader 23, personal user information readfrom the storage unit 28, playback-time-zone information indicating inwhich time zone the content is played back on the information provider25, and so on. The encoded transmitting information is sent from thetransmitter/receiver 22 to the server 30 via a network.

[0114] The server 30 analyzes the content title information, the useroperation information, i.e., the user favorite data, the personal userinformation, the playback-time-zone information, etc., contained in thetransmitting information, so as to generate value-added information asthe content digest information. This will be discussed in detail below.The value-added information includes popular title information, popularscene information, uninteresting scene information, etc., which willalso be described below. The value-added information may be formed of acorresponding frame in the content, or may be index information of thecorresponding frame. The value-added information is sent to the contentplayback apparatus 20. The accounting server 40 bills an informationusage fee to the user of the content playback apparatus 20 whenproviding the value-added information.

[0115] In the content playback apparatus 20, the value-added informationis received by the transmitter/receiver 22, and the received informationdecoder 27 performs a predetermined decoding operation on the receivedvalue-added information. Additionally, the popular title information,the popular scene information, the interesting scene information, theuninteresting scene information, etc., are extracted from thevalue-added information, and are supplied to the CPU 21.

[0116] The CPU 21 is able to control the content playback operationperformed by the media reader 23 and the information provider 25 basedon the value-added information. More specifically, various value-addedplayback services, such as searching popular titles, playing back onlypopular scenes (digest), skipping uninteresting scenes, etc., can beprovided.

[0117] In FIG. 2, only one content playback apparatus 20 is shown. Inpractice, however, many content playback apparatuses 20 are connected tothe server 30, and the user operation information, the content titleinformation, the personal user information, the playback-time-zoneinformation, etc., are transmitted from each playback apparatus 20, andare stored in the server 30.

[0118] The server 30 is formed of a CPU 31, a transmitter/receiver 32, areceived-information decoder 33, a received-information storage unit 34,a value-added information generator 35, a transmitting-informationselector 36, a transmitting-information encoder 37, and a value-addedinformation storage unit 38. Under the control of the CPU 31, the server30 stores and computes the received information from the contentplayback apparatus 20, such as the user operation information, and alsocreates the content digest information by performing statisticalprocessing and then distributes it.

[0119] The user operation information, i.e., the user favorite data, thecontent title information, the personal user information, theplayback-time-zone information, etc., sequentially received by thetransmitter/receiver 32, are subjected to predetermined decodingprocessing in the received-information decoder 33, and are then storedin the received-information storage unit 34.

[0120] The value-added information generator 35 reads the user operationinformation, i.e., the user favorite data, the content titleinformation, the personal user information, the playback-time-zoneinformation, etc., from the received information storage unit 34, andperforms statistical processing on such information, thereby generatingthe value-added information as the content digest information. Thegenerated value-added information is sequentially stored in thevalue-added information storage unit 38. The value-added information maybe formed of a corresponding frame in the content, or may be indexinformation of the corresponding frame.

[0121] The transmitting-information selector 36 selects the value-addedinformation to be sent to each client, and delivers it to thetransmitting-information encoder 37. The transmitting-informationencoder 37 encodes the selected value-added information, and outputs itto the transmitter/receiver 32.

[0122] The transmitter/receiver 32 distributes the value-addedinformation to a specific client, i.e., a specific content playbackapparatus 20. In this case, only the clients which have paid orconfirmed to pay for the usage of the value-added information canreceive the value-added information. Accordingly, the server 30 maycharge for the value-added information or for the services for playingback the value-added information. When the value-added information issent, the accounting server 40 may bill an information usage feedifferent from the content usage fee which is billed when the content issent.

[0123] As stated above, the value-added information includes, forexample, popular title information, popular scene information, anduninteresting scene information (or index information for specifyingthese scenes). These items of information are created based on theinformation concerning the age, the gender, and the playback time zonecontained in the personal user information according to the age group(for example, teenagers, twenties, or thirties), the gender, thelife-style (for example, office worker type: mainly viewing/listening tothe content in the evening; housewife type: mainly viewing/listening tothe content in the daytime; and student type: mainly viewing/listeningto the content from midnight to early morning). It is necessary,however, to assume that users leading similar life-styles are interestedin the same type of favorite content.

[0124] The popular title information is created based on storedinformation of the content titles sent from the individual contentplayback apparatuses (for example, the title attached to a medium, suchas a DVD, which is currently loaded in a media tray of the contentplayback apparatus). The popular title information may include a populartitle ranking which indicates the frequently viewed/listened titles.

[0125] The popular scene information is created based on the stored dataof the content title information and the user operation information sentfrom the individual content playback apparatuses. The popular sceneinformation is generated by accumulatively adding popular points to thescenes which are frequency played back. A greater weight may be appliedto the scenes which are repeatedly played back by fast-forwarding orrewinding.

[0126] The uninteresting scene information is created based on thestored data of the content title information and the user operationinformation sent from the individual content playback apparatuses. Theuninteresting scene information is generated by accumulatively addinguninteresting points to the scenes which are less frequently playedback.

[0127] The content playback apparatus 20 is able to receive thevalue-added information from the server 30 by, for example, paying for avalue-added information usage fee, thereby enjoying the value-addedinformation services (playing back the value-added information). Theaccounting processing for the services can be performed by theaccounting server 40 on the network.

[0128] The content playback apparatus 20 is able to select the favoriteinformation or the type of content playback operation by utilizing thevarious types of value-added information. More specifically, thefollowing features can be implemented in the content playback apparatus20: (1) searching for popular titles, for example, obtaining currentlypopular titles; (2) performing a digest playback operation, for example,selecting and playing back the scenes only having the highest popularpoints; and (3) skipping uninteresting scenes, for example, skipping thescenes having the highest uninteresting points while playing back thecontent.

[0129] The above-described value-added information services are preparedaccording to attributes, such as the age group, the gender, thelife-style, etc.

[0130]FIG. 3 is a flow chart illustrating the processing executed by thecontent playback apparatus 20 according to this embodiment of thepresent invention. In practice, this processing is implemented byexecuting a predetermined program code by the CPU 21. The operation ofthe content playback apparatus 20 is described below with reference tothe flow chart of FIG. 3.

[0131] The CPU 21 determines in step S1 whether the user has made arequest to send value-added information by operating the operationinformation interface 24.

[0132] If the outcome of step S1 is no, the process proceeds to step S6in which the CPU 21 causes the content playback apparatus 20 to performa regular operation, such as play, fast-forward, pause, or rewind, inresponse to the user operation. Then, in step S7, the title informationof the content loaded in the media tray, the user operation information,the playback-time-zone information, the personal user information, etc.,are transmitted to the server 30 as material data for creating contentdigest information.

[0133] If it is found in step S1 that the user has made a request tosend value-added information, the process proceeds to step S2. In stepS2, the request is encoded in the transmitting-information encoder 26,and is then sent to the server 30 by the transmitter/receiver 22. As aresult, in step S3, the content playback apparatus 20 receives thevalue-added information from the server 30 as the content digestinformation. In step S4, the user of the content playback apparatus 20is able to enjoy the value-added information services. The accountingserver 40 may perform predetermined accounting processing whentransmitting and receiving the value-added information.

[0134] The value-added information services include a popular titlesearch to obtain currently popular title information, a digest playbackoperation for selecting and playing back the scenes only having thehighest popular points, and a skip playback operation for skippinguninteresting scenes having the highest uninteresting points whileplaying back the content.

[0135] It is then determined in step S5 whether the user has finishedthe operation by using the operation information interface 24, forexample, whether the user has finished the content playback operation orturned off the power source of the content playback apparatus 20. If theoutcome of step S5 is yes, this processing routine is completed.

[0136] If the result of step S5 is no, the process returns to step S1,and the processing of step S1 and the subsequent steps is repeated.

[0137]FIG. 4 is a flow chart illustrating the processing executed by theserver 30 according to this embodiment of the present invention. Inpractice, this processing is implemented by executing a predeterminedprogram code by the CPU 31. The operation of the server 30 is discussedbelow with reference to the flow chart of FIG. 4.

[0138] In step S11, when the transmitter/receiver 32 receives the titleinformation, the user operation information, i.e., the user favoritedata, the playback-time-zone information, the personal user information,etc., from the individual content playback apparatuses 20 connected tothe server 30 via a network, these items of information are stored inthe received-information storage unit 34.

[0139] Then, in step S12, the value-added information generator 35 readsthe title information, the user operation information, theplayback-time-zone information, and the personal user information fromthe received-information storage unit 34, and performs predeterminedstatistical processing on these items of information, thereby generatingvalue-added information as the content digest information. The generatedvalue-added information is stored in the value-added information storageunit 38.

[0140] It is then determined in step S13 whether a request to send thevalue-added information has been received from the content playbackapparatus 20. If the result of step S13 is yes, the process proceeds tostep S14 in which the corresponding value-added information is read fromthe value-added information storage unit 38, and is sent to thecorresponding content playback apparatus 20. When sending thevalue-added information, an information usage fee different from thecontent usage fee may be billed. The accounting processing for billingthe use of the value-added information may be performed by theaccounting server 40.

[0141] In this embodiment, the value-added information can be generatedaccording to the age group, the gender, or the life-style, in the server30, and the client, i.e., the content playback apparatus 20, is able toselect the type of content playback operation suitable for the client byutilizing the value-added information. As discussed above, thevalue-added information is generated based on the user operationinformation obtained by performing the regular operation, such as play,pause, fast-forward, and rewind. Accordingly, the user simply views orlistens to the scenes that he/she desires without the need to perform aspecial operation. In other words, the scenes played back by each useris statistically processed so as to automatically generate scenes thatthe user wishes to view as the value-added information.

[0142] The content playback apparatus 20 is described more specificallyin the context of a DVD player for playing back data content recorded ona DVD. A description is now given of the processing for generating anddistributing the value-added information according to this embodimentwhen a DVD player is used as the content playback apparatus 20.

[0143]FIG. 5 is a schematic block diagram illustrating the hardwareconfiguration of a DVD player applied to this embodiment of the presentinvention.

[0144] A DVD player 50 includes the following elements, as shown in FIG.5. A pickup 52 plays back a radio frequency (RF) signal from a DVD 51.An RF circuit 53 receives the RF signal from the pickup 52 and binarizesit. A data decoder 54 receives the playback data from the RF circuit 53and performs decoding processing, such as error correction. Ademultiplexer 55 demultiplexes the playback data decoded by the datadecoder 54 into encoded video data, encoded SP data, and encoded audiodata. A code buffer 56 temporarily stores the encoded video datareceived from the demultiplexer 25. A video decoder 57 decodes (in thiscase, expands) the encoded video data received from the code buffer 56.A code buffer 58 temporarily stores the encoded SP data supplied fromthe demultiplexer 55. An SP decoder 59 decodes the encoded SP datasupplied from the code buffer 58. A code buffer 60 temporarily storesthe encoded audio data supplied from the demultiplexer 55. An audiodecoder 61 decodes the encoded audio data received from the code buffer60.

[0145] The DVD player 50 also includes the following elements. Adigital-to-NTSC or PAL conversion circuit (hereinafter simply referredto as the “NTSC conversion circuit”) 62 receives the decoded video dataand the decoded SP data from the SP decoder 59, and converts them intoan NTSC signal or a PAL signal. A digital-to-analog conversion circuit(hereinafter simply referred to as the “D/A conversion circuit”) 63receives the decoded audio data from the audio decoder 61, and convertsit into an analog signal. A controller 64 controls the pickup 52, the RFcircuit 53, the data decoder 54, the demultiplexer 55, the video decoder57, the SP decoder 59, the audio decoder 61, the NTSC conversion circuit62, and the D/A conversion circuit 63. A user interface 65 interfacesthe controller 64 and a user input operation. A memory 66 serves as adata storage unit of the controller 64. A transmitter/receiver 67 sendsand receives data with the external server 30 (not shown in FIG. 5).

[0146] In response to a request from the user via the user interface 65that a DVD is to be played back by splicing the above-describedmultiplexed information signal having a predetermined playback unit toanother multiplexed information signal without causing a breaktherebetween, the controller 64 detects the time length from theswitching time of the demultiplexer 55 to the time when the videodecoder 57 outputs the video data, and controls the decoding operationof the SP decoder 59 according to the detected time length. In thisembodiment, the user interface 65 includes instruction buttons (notshown) for regular operations performed on the content recorded on theDVD 51, such as play, fast-forward, pause, rewind, skip, etc. on thecontent. The user interface 65 may also include instruction buttons forspecifying favorite scenes or uninteresting scenes.

[0147] In response to the above-described request from the user, thecontroller 64 also detects the time length from the switching time ofthe demultiplexer 55 to the time when the video decoder 57 outputs thevideo data, and controls the decoding operation of the audio decoder 61according to the time length.

[0148] Generally, on a DVD as a recording medium, as shown in FIG. 6,data is recorded in the unit “Video Object Set” (hereinafter referred toas a “VOBS”), which is a unit for, for example, a piece of movie. ThisVOBS is formed of a plurality of “Video Objects” (hereinafter referredto as a “VOB”). The DVD has a multi-story format which enables a viewerto observe different stories for one movie. According to this function,each VOB has a different story.

[0149] The VOB is formed of a plurality of cells (Cell). The cell is aunit for one scene of, for example, a movie. Accordingly, a combinationof the different scenes forms a VOB. According to different types ofcombinations of the scenes, the multi-story function can be implemented.According to this multi-story function, a plurality of stories arerecorded on a DVD, and a viewer is able to select a desired story on amenu displayed while playing back the content.

[0150] The cell is formed of a plurality of “Video Object Units”(hereinafter referred to a “VOBU”). The VOBU has a unit of 0.8 to 1.2seconds for a moving picture, and contains “Group of Pictures”(hereinafter referred to as “GOPs”) in the MPEG2 format.

[0151] In the DVD-VIDEO standards, the program chain (PGC) structure isdefined, as shown in FIG. 7. In this structure, based on PGC information(PGCI) indicating the presentation essence and order, data is recordedas a PGC formed of a plurality of programs (PG). In most cases, theabove-described cells are not recorded on the DVD in the playback order,and the information concerning the playback order and the recordingposition of the cells is recorded on the PGCI of the DVD.

[0152] The PGC is a logical unit for providing the individual menuscreens, video data, and titles, and is formed based on the PGCI. OnePGC is divided into an integral number of PGs. The PG is a unit obtainedby dividing the content of the PGC. One PG is formed of an integralnumber of cells. In the DVD player, the PGCI is obtained, and the PGC isplayed back based on the PGCI. The PGCI is formed of a pre-command area,a post-command area, and a presentation control block. According to thispresentation control block, a navigation command for controlling theplayback order of cells and the presentation is provided.

[0153]FIG. 8 is a flow chart illustrating the processing performed bythe DVD player 50, which serves as a client. In practice, thisprocessing is implemented by reading a predetermined program code fromthe memory 66 and executing it by the controller 64. The clientprocessing is now described with reference to the flow chart of FIG. 8.

[0154] The controller 64 first determines in step S71 whether the userhas made a request to send value-added information via the userinterface 65.

[0155] If the outcome of step S71 is no, the process proceeds to stepS76 in which the DVD player 50 performs a regular playback operation onthe content. The regular operation includes play, fast-forward, pause,and rewind operations. Then, in step S77, the ID number of the currentlyoperated VOB (hereinafter simply referred to as the “playback VOB ID”)and the ID number of the currently operated cell (hereinafter simplyreferred to as the “playback cell ID”) are detected. Then, in step S78,the title ID of the DVD content which is currently played back, the VOBID, the cell ID, the playback-time-zone information, and the personalinformation are sent to the server 30 via the transmitter/receiver 67 asmaterial data used for generating the content digest information. Whilethe content is being played back, the above-described processing isrepeated.

[0156] If it is found in step S71 that the user has made a request tosend value-added information, the process proceeds to step S72 in whichthe request is sent to the external server 30 by thetransmitter/receiver 67. As a result, in step S73, the content playbackapparatus 20 (DVD player 50) receives the PGC data from the server 30 asthe value-added information. In step S74, the DVD player 50 is able toplay back the value-added information of the DVD content, as discussedabove. The server 30 may perform accounting processing for billing aninformation usage fee different from the content usage fee when sendingthe value-added information. This accounting processing may be performedby the accounting server 40.

[0157] The value-added information services include a popular titlesearch to obtain currently popular title information, a digest playbackoperation for selecting and playing back the scenes only having thehighest popular points, and a skip playback operation for skippinguninteresting scenes having the highest uninteresting points whileplaying back the content.

[0158] It is then determined in step S75 whether the user has finishedthe operation by using the operation information interface 65, forexample, whether the user has finished the content playback operation orturned off the power source of the DVD player 50. If the outcome of stepS75 is yes, this processing routine is completed.

[0159] If the result of step S75 is no, the process returns to step S71,and the processing in step S71 and the subsequent steps is repeated.

[0160]FIG. 9 is a flow chart illustrating the processing performed bythe server 30 for providing value-added information services to each DVDplayer 50. In practice, this processing is implemented by executing apredetermined program code by the CPU 31. The operation of the server 30is discussed below with reference to the flow chart of FIG. 9.

[0161] In step S81, the transmitter/receiver 32 of the server 30receives user favorite data, such as the playback title ID, the playbackVOB ID, and the playback cell ID, the playback-time-zone information,and the personal user information from each DVD player 50 via a network,and these items of information are stored in the received-informationstorage unit 34.

[0162] Then, in step S82, the title information, the user operationinformation, the playback-time-zone information, the personal userinformation, etc., are read from the received-information storage unit34, and the value-added information generator 35 performs statisticalprocessing on these items of information, thereby generating thevalue-added information. The value-added information is then stored inthe value-added information storage unit 38.

[0163] It is then determined in step S83 whether a request to send thevalue-added information has been received from the DVD player 50. If theoutcome of step S83 is yes, the process proceeds to step S84 in whichPGC data is generated based on the corresponding value-addedinformation. Then, in step S85, the PGC data is sent to thecorresponding client by the transmitter/receiver 32. It is thendetermined in step S86 whether the user has finished the operation. Ifthe result of step S86 is yes, this processing routine is completed. Ifthe outcome of step S86 is no, the process returns to step S81 in whichthe corresponding processing is repeated. The server 30 may bill for aninformation usage fee different from the content usage fee when sendingthe value-added information. This processing may be performed by theaccounting server 40.

[0164]FIG. 10 is a flow chart illustrating the processing for generatingthe value-added information of the content by the server 30. Inpractice, this processing is implemented by executing a predeterminedprogram code by the CPU 31. The processing for generating thevalue-added information is discussed below with reference to the flowchart of FIG. 10.

[0165] In step S91, the transmitter/receiver 67 receives the userfavorite data indicating the playback title ID, the playback VOB ID, andthe playback cell ID, the playbacktime-zone information, and thepersonal information from each DVD player 50, which serves as a client.

[0166]FIG. 11 schematically illustrates the result obtained by computingthe content playback information sent from the users of the DVD players.As shown in FIG. 11, the VOB IDs and the cell IDs of the content whichwas played back by each user can be specified.

[0167] In step S92, the corresponding database is selected based ontarget information, such as the title, the playback time zone, or thepersonal information. In this embodiment, the value-added informationdatabase is stored by being classified, as shown in FIG. 12, accordingto the title, the personal information, and the playback time zone.

[0168] Subsequently, in step S93, the currently played back VOB ID andthe cell ID are added and stored to the selected database.

[0169]FIG. 13 illustrates the result obtained by accumulatively addingthe playback VOB ID and the playback cell ID. As shown in FIG. 13,according to this accumulation result, the frequency of playbackoperations of each VOB ID or each cell ID can be shown as a histogram.

[0170] In response to a request to send the value-added information fromthe DVD player 50, which serves as a client, the server 30 creates PGCdata based on the value-added information shown in FIG. 13, and returnsit to the client. For example, if the client has made a request to sendthe value-added information for the digest playback operation, theserver 30 creates the PGC data for enabling the client to play back onlythe VOBs and cells having a frequency of playback operations of apredetermined threshold or greater, and sends the created PGC data tothe client. If the client has made a request to send the value-addedinformation for the skip playback operation, the server 30 creates thePGC data for enabling the client to skip the VOBs and cells having thefrequency of playback operations of a predetermined threshold or lower,and sends the created PGC data to the client.

[0171] The server 30 may bill for an information usage fee differentfrom the content usage fee when sending the PGC data. The accountingprocessing may be performed by the accounting server 40.

[0172]FIG. 14 schematically illustrates the configuration of a networksystem 110 according to another embodiment of the present invention. Thenetwork system 110 is formed of: a content distribution server 130 fordistributing or delivering the content of a time-based event (forexample, sport programs and dramas) and content digest information; atleast one client 120-A, 120-B, and so on (hereinafter referred to as the“client 120” unless it is necessary to distinguish them individually)for receiving and viewing the content; and an accounting server 140 forperforming accounting processing for the distribution and delivering ofthe digest information. The distribution or the delivering of theinformation content may be charged to the user, or the user may receiveit free. The content may be distributed via broadcast waves (not shown)rather than a network.

[0173] In this embodiment, the client 120 is provided with a device forspecifying a scene that the client 120 wishes to view, which isdiscussed in detail below. The server 130 is able to dynamicallygenerate a digest scene as the content digest information of the event,and provides it in response to a request sent from the client 120 byusing the above-described device.

[0174] For example, for the viewers who have started to watch the eventhalf way through, a digest scene indicating the past progress of theevent can be provided. According to the time when the viewer has startedto watch the event, an optimal digest scene can be continuouslygenerated. Thus, even for the viewers who have started the event halfway through, they are informed of the past progress of the event basedon the digest scene, and are thus able to follow the subsequent event.

[0175]FIG. 15 is a block diagram illustrating the functionalconfiguration of the client 120 and the content distribution server 130.

[0176] The client 120 is formed of, as shown in FIG. 15, atransmitter/receiver 121, a received-information decoder 122, aninformation provider 123, an instruction-information interface 124, atransmitting-information encoder 125, and a CPU 126. Under the overallcontrol of the CPU 126, the client 120 is able to play back the receivedcontent and perform the accompanying processing (for example, playingback the value-added information of the received content).

[0177] The content of the event distributed from the contentdistribution server 130 is received by the transmitter/receiver 121. Thereceived-information decoder 122 then decodes the received data toreproduce the original content, and provides it to the viewer on theinformation provider 123.

[0178] The instruction-information interface 124 is formed of a devicefor specifying a scene, such as an interesting scene, an uninterestingscene, a scene that the user wishes to watch. By using theinstruction-information interface 124, the user is able to specify thescene spatially or temporally. The instruction information input by theuser via the instruction-information interface 124 can be used asmaterial data for creating a digest scene. The instruction informationis then sent to the transmitting-information encoder 125. Thetransmitting-information encoder 125 then encodes the instructioninformation and sends it to the content distribution server 130 by thetransmitter/receiver 121.

[0179] Only one client 120 is shown in FIG. 15. In practice, however,many clients are connected to the content distribution server 130, and aplurality of pieces of instruction information are accordingly sent tothe content distribution server 130 from the individual clients 120 andare stored in the server 130.

[0180] The content distribution server 130 is formed of a CPU 131, atransmitter/receiver 132, a received-information decoder 133, aninstruction-information storage unit 134, a content storage unit 135, acurrent information acquiring unit 136, a digest creator 137, atransmitting-information selector 138, and a transmitting-informationencoder 139. Under the control of the CPU 131, the content distributionserver 130 distributes the content, and also dynamically creates adigest scene as the content digest information and distributes it.

[0181] The instruction information sequentially received by thetransmitter/receiver 132 is decoded in the received-information decoder133, and is stored in the instruction-information storage unit 134.

[0182] The real-time information acquiring unit 136, which is, forexample, a camera device, a microphone, or an audio recording device,obtains the distribution content in real time. When regular contentdistribution processing is performed, the real-time information is sentto the transmitting-information encoder 139 via thetransmitting-information selector 138 and is encoded. Then, the encodedreal-time information is distributed to each client 120 from thetransmitter/receiver 132. The real-time information is also stored inthe content storage unit 135.

[0183] The digest creator 137 dynamically creates a digest scene of theevent content as the digest information. For example, the digest creator137 reads the instruction information from instruction-informationstorage unit 134, and performs statistical processing on the instructioninformation, thereby extracting the portions which have been frequencyspecified in the time-space domain as the digest scene. Details ofprocessing for creating the digest scene are given below.

[0184] The digest scene as the content digest information is createdcontinuously, and is supplied to the transmitting-information selector138. According to the operating mode, the transmitting-informationselector 138 selects the real-time content supplied from the real-timeinformation acquiring unit 136 or the corresponding digest scene, andsends the selected information to the transmitting-information encoder139. That is, the real-time content is selected when distributing theregular content, and the digest scene is selected in response to arequest to send the digest scene.

[0185] The transmitting information selected by thetransmitting-information selector 138 is encoded in thetransmitting-information encoder 139, and is then distributed to theclient 120 from the transmitter/receiver 132. Instead of the digestscene itself, index information for extracting the digest scene from theoriginal content may be transmitted to the client 120.

[0186] The content distribution server 130 may bill an information usagefee different from the content usage fee when sending the digest scene.This accounting processing may be performed by the accounting server140.

[0187]FIG. 16 is a flow chart illustrating the processing performed byboth the client 120 and the server 130 when the regular contentdistribution processing is executed. In practice, this processing isimplemented by a cooperative operation of the CPU 126 of the client 120and the CPU 131 of the server 130. In the example shown in FIG. 16,assist communication is applied to the content distribution. The “assistcommunication” is a system which performs high-resolution encoding onthe portions (scenes) that the user has specified, and performslow-resolution encoding on the portions (scenes) that the user has notspecified. According to this system, an image desired by the user can beprovided using a small bandwidth. In order to enjoy this advantage, theviewer has to specify the portions (scenes) that he/she wishes to watch.Conversely, however, by specifying the scenes that the viewer wishes towatch, such scenes can be provided with high resolution. This provides astrong incentive to viewers to provide material data for creating adigest scene to the content distribution server 130.

[0188] The regular content distribution processing according to thisembodiment is described below with reference to the flow chart of FIG.16.

[0189] In steps S21 and S31, the image content is transmitted andreceived between the client 120 and the content distribution server 130.In the server 130, the real time content to be transmitted is read fromthe real-time information storage unit 136, and is subjected topredetermined encoding in the transmitting-information encoder 139.Then, the encoded content is distributed from the transmitter/receiver132. In the client 120, the received content is subjected topredetermined decoding processing in the received-information decoder122, and is then provided on the information provider 123, such as amonitor display. The image content may be a time-based event, such as amovie, drama, or a sport program, or may be the broadcast contentdistributed from a predetermined broadcast station.

[0190] While there is no input of instruction information from theinstruction-information interface 124 in the client 120 (i.e., theresult of step S22 or S32 is no), regular encoding processing isperformed in the content distribution server 130 in step S37. Then, theimage content continues to be transmitted and received in steps S21 andS31. The “regular encoding processing” described above is to encode thecontent so that, for example, the information is uniformly allocated inthe time-space domain.

[0191] If it is found in step S22 that there is an input of instructioninformation from the instruction-information interface 124 of the client120, the process proceeds to step S23. In step S23, the inputinstruction information is encoded in the transmitting-informationencoder 125, and is sent from the client 120 to the server 130. In stepS33, the server 30 accordingly receives the instruction information. Asdiscussed below, the input instruction information is used as materialdata for creating a digest scene.

[0192] In the content distribution server 130, in step S35, the receivedinstruction information is decoded in the received-information decoder133, and is then stored in the instruction-information storage unit 134.The stored instruction information is to be utilized for creating adigest scene. In step S36, high-resolution encoding is performed inresponse to an instruction from the client 120. That is, moreinformation is assigned to the portions that the client 120 hasspecified than other portions. Then, more detailed information isprovided to the viewer. In order to enjoy this advantage, the viewer hasto specify the scenes that he/she wishes to watch. Conversely, however,by specifying the scenes that the viewer wishes to watch, such scenescan be provided with high resolution. This provides a strong incentiveto viewers to provide material data for creating a digest scene to thecontent distribution server 130.

[0193]FIG. 17 is a flow chart illustrating the processing fordynamically creating the digest scene as the content digest information.In practice, this processing is implemented by a cooperative operationof the CPU 131 and the digest creator 137 of the content distributionserver 130. The processing for creating the digest scene is describedbelow with reference to the flow chart of FIG. 17.

[0194] As discussed above, the instruction information supplied from theindividual viewers, i.e., the clients 120, is stored in theinstruction-information storage unit 134. In step S141, the digestcreator 137 reads the instruction information from theinstruction-information storage unit 134.

[0195] The instruction information is not uniformly arranged in thetime-space domain, but is non-uniformly distributed according to theinterest of the viewers. Accordingly, in step S42, the portions whichhave been more frequency specified in the time-space domain areextracted by the digest creator 137, and in step S43, the timeinformation of such portions is read. In step S44, the content areacorresponding to the time information read in step S43 is output to thetransmitting-information selector 138 as the digest data. The digestdata may be a set of scenes or frames corresponding to the content timeinformation, or may be index information for specifying thecorresponding scenes or frames from the content.

[0196] For example, the frequency distribution of the time informationcan be formed based on the instruction information from many viewers,and the time information which is more frequently specified is selected,thereby creating the digest scene. FIG. 18 is a histogram for extractingthe digest scene. The digest creator 137 accumulates the points in thetime domain at which an instruction is input from a viewer so as togenerate a histogram indicating the frequency of instructions.

[0197] The digest creator 137 also creates, as shown in FIG. 19, adigest table in which the distribution (broadcast) times which are morefrequency specified are listed as candidates of the digest scene.

[0198] In the digest table, sorting is sometimes performed according tothe magnitude of the evaluation value obtained by the number ofinstructions detected at the corresponding time. The instructioninformation is continuously input in the client 120, and thus, thehistogram is constantly changing. Accordingly, the order of thecandidates in the digest table is changed in real time. For example, ifthe current evaluation value is greater than the past evaluation value,the rank of the corresponding candidate becomes higher. Accordingly, thedigest data output from the digest creator 137 is constantly changingreal time data.

[0199] In this embodiment, the digest table shown in FIG. 19 is createdbased on the instruction information from many viewers, and the digestscene is determined by selecting the higher rank of the candidates. Forexample, the number of digest scenes is determined in advance, and thepredetermined number of candidates having the higher ranks aresequentially selected, thereby extracting the digest scenes. Togetherwith the digest scenes, the digest information is extracted from a linkto the stored event, and both the digest scenes and the digestinformation are output. The length of the scene may be determined by theinterval between the two scenes. Alternatively, a predetermined periodmay be allocated to the length of the scene.

[0200]FIG. 20 is a flow chart illustrating the processing fordistributing the digest information. In practice, this processing isimplemented by a cooperative operation of the CPU 126 of the client 120and the CPU 131 of the content distribution server 130. The processingfor distributing the digest information is discussed below withreference to the flow chart of FIG. 20.

[0201] It is determined in step S51 whether the client 120 has made arequest to send a digest scene. If the outcome of step S51 is yes, theprocess proceeds to step S52 in which the request is sent to the contentdistribution server 130. User profile information of the client 120,such as the age group, the gender, the life-style, etc., may be attachedto the above-mentioned request.

[0202] In the content distribution server 130, the request from theclient 120 is received by the transmitter/receiver 132 in step S61.Then, in step S62, the digest scene is dynamically created according tothe processing shown in FIG. 17. As stated above, “dynamically” meansthat the digest scene is updated according to the instructioninformation continuously supplied from the clients, i.e., the viewers.

[0203] In the content distribution server 130, in step S63, a suitableentry is extracted from the digest table shown in FIG. 19, and is sentto the corresponding client 120 as the digest scene. For example, theleading entry having the highest evaluation rank in the digest table maybe sent as the digest scene, or the entries in the digest table may befiltered according to the user profile information of the client 20.

[0204] The content distribution server 130 may bill for an informationusage fee different from the content usage fee when sending the dynamicdigest scene. This accounting processing may be performed by theaccounting server 140 on the network.

[0205] If it is found in step S51 that the user has not made a requestto send a digest scene, the process proceeds to step S54 in whichregular processing shown in FIG. 8 is performed. Accordingly, in stepS64, the content distribution server 130 performs regular processingshown in FIG. 9.

[0206] During the regular processing, the real-time content, such as areal-time image, is distributed from the content distribution server130, and the client 120 is thus able to enjoy watching this real-timecontent. The client 120 inputs instruction information by using theinstruction-information interface 124 every time his/her favorite sceneis displayed. According to the above-described assist communicationsystem, an incentive is given to the user to receive high-resolutionimages. Then, the instruction information is transferred from the client120 to the content distribution server 130, and is stored in theinstruction-information storage unit 134.

[0207] It is then determined in step S55 whether the client 120 providesan instruction to complete this processing by, for example, finishingthe regular processing. If the outcome of step S55 is yes, a completionsignal is sent to the content distribution server 130 in step S56. Uponreceiving the completion signal, the content distribution server 130also finishes the regular processing (the result of step S65 is yes),and the overall processing routine is completed.

[0208] According to the above-described embodiment, in the contentdistribution system for providing a time-based event (for example, asport program or a drama), a digest scene is dynamically created as thecontent digest information in response to a request from a viewer, andis provided to the corresponding client 120. For example, for theviewers who have watched an event half way through, the digest sceneindicating the past progress of the event can be provided. It is thuspossible to provide an optimal digest scene According to the time whenthe viewer has started to watch the event.

[0209]FIG. 21 illustrates the schematic configuration of a networksystem 210 according to still another embodiment of the presentinvention. The network system 210 is formed of: as shown in FIG. 21, acontent distribution server 230 for distributing the content of atime-based event (for example, a sport program or a drama) and also forcreating digest information of the content; at least one client 220A,220B, and so on (hereinafter referred to as the “client 220” unless itis necessary to distinguish them individually) for receiving and viewingthe content; and an accounting server 250 for performing accountingprocessing on the delivering or the distribution of the digestinformation. The delivering or the distribution of the content from thecontent distribution server 230 may be charged to user, or the user mayreceive it free. The content may be distributed via broadcast waves (notshown) rather than a network.

[0210] In this embodiment, the client 220 is provided with a device forspecifying a scene that the user wishes to watch, which is describedbelow. Thus, the content distribution server 230 is able to performstatistical processing, for example, averaging the requests of theviewers obtained by the instructions from the users using theabove-described device, thereby creating an averaged digest as thecontent digest information. The content distribution server 230 alsocreates a personal digest which reflects the favorite information of thecorresponding user, and provides the personal digest to the user as thecontent digest information. The personal digest can be created from thedifference between the favorite information of the corresponding userand the averaged digest.

[0211] For example, many pieces of favorite information for the content,such as movies, dramas, or sport programs, are collected from aplurality of viewers and are averaged, thereby creating an averageddigest. This averaged digest may be sold to the viewers who have notwatched the corresponding content. According to the difference betweenthe averaged digest and the individual favorite information, a personaldigest reflecting more personal favorites can be created. This personaldigest may be given back to the viewers who have provided their favoriteinformation. This gives an incentive to the user to receive a personaldigest, in which case, the user is motivated to provide his/her favoriteinformation required for creating an averaged digest.

[0212]FIG. 22 is a block diagram illustrating the functionalconfiguration of the client 220 and the content distribution server 230.

[0213] The client 220 includes, as shown in FIG. 22, atransmitter/receiver 221, a received-information decoder 222, aninformation provider 223, an information providing interface 224, atransmitting-information encoder 225, and a CPU 226. Under the overallcontrol of the CPU 226, the client 220 is able to receive the contentand the corresponding digest information, and also performs thecorresponding accompanying processing (for example, providing the digeston the information provider 223.

[0214] The content of a time-based event sent from the contentdistribution server 230 is received by the transmitter/receiver 221. Thereceived-information decoder 222 decodes the received data to reproducethe original content, and provides it on the information provider 223.

[0215] The information providing interface 224 is formed of a device forenabling the user to input favorite information, such as an interestingscene, an uninteresting scene, a scene that the user wishes to watch,while viewing the content. By using the information providing interface224, the user is able to spatially or temporally specify the scene. Theuser favorite information input by the user via the informationproviding interface 224 can be used as material data for creating thecontent digest information in the content distribution server 230. Theuser favorite information is then sent to the transmitting-informationencoder 225. The transmitting-information encoder 225 encodes the userfavorite information and sends it to the content distribution server 230by the transmitter/receiver 221.

[0216] Only one client 220 is shown in FIG. 22. In practice, however,many clients are connected to the content distribution server 230, and aplurality of pieces of user favorite information are accordingly sent tothe content distribution server 230 from the individual clients 220 andare stored in the server 230.

[0217] The content distribution server 230 includes a CPU 231, atransmitter/receiver 232, a received-information decoder 233, afavorite-information storage unit 234, an averaged-digest creator 236, apersonal-digest creator 237, a transmitting-information selector 238, atransmitting-information encoder 239, a content-information storage unit240, a personal-digest storage unit 241, and an averaged-digest storageunit 242. Under the overall control of the CPU 231, the contentdistribution server 230 distributes the content, and also creates anddistributes the averaged digest scene or the personal digest scene.

[0218] The user favorite information sequentially received by thetransmitter/receiver 232 is decoded in the received-information decoder233, and is stored in the favorite-information storage unit 234.

[0219] The content-information storage unit 240 stores informationcontent as the main subject of the distribution services. Theinformation content is, for example, a time-based event, such as amovie, a drama, or a sport program.

[0220] The averaged-digest creator 236 extracts the content informationfrom the content-information storage unit 240. It also extracts thefavorite information of the individual viewers from thefavorite-information storage unit 234, and performs statisticalprocessing, for example, averaging the user favorite information,thereby creating an averaged digest as part of the content digestinformation. The averaged digest is stored in the averaged-digeststorage unit 242. The averaged digest may be sold to the users who havenot watched the event. The averaged digest may be formed of acorresponding scene or frame in the content, or may be index informationfor extracting the corresponding scene or frame from the content.

[0221] Since the users' favorites are different, the user favoriteinformation is distributed non-uniformly in the time domain.Accordingly, in this embodiment, the scenes favored by many users areextracted as the averaged digest. For example, the total digest time isdetermined, and the scenes are extracted in the order of the scenesspecified by a greater number of users until the total digest time isreached. It is thus possible to create the averaged digest reflectingmany users favorites.

[0222] The personal-digest creator 237 extracts the content informationfrom the content-information storage unit 240. It also extracts thefavorite information of the individual viewers from thefavorite-information storage unit 234 and the averaged digest from theaveraged-digest storage unit 242. The personal-digest creator 237 thencreates as part of the content digest information a personal digestreflecting the favorites of a specific user from the difference betweenthe favorite information input from the specific user and the averageddigest. The created personal digest is stored in the personal-digeststorage unit 241. The personal digest may be sold to the users who havenot watched the event. The personal digest may be formed of acorresponding scene or frame in the content, or may be index informationfor extracting the corresponding scene or frame from the content.

[0223] The favorite information provided by each user has portions whichoverlap with the averaged digest and portions which do not overlaptherewith. A personal digest may be created for a specific user byemphasizing the portions unique to the favorite information of the user,which reflects the difference of the favorites between the user and theother users. For example, the total digest time is determined, and thescenes unique to the favorite information of the user and the adjacentscenes are extracted until the total digest time is reached. If all thescenes unique to the user favorite information are extracted before thetotal digest time is reached, suitable scenes are extracted from theaveraged digest, and are filled in the personal digest until the totaldigest time is reached.

[0224] According to the operating mode, the transmitting-informationselector 238 selects among the information content from thecontent-information storage unit 240, the averaged digest from theaveraged-digest storage unit 242, and the personal digest from thepersonal-digest storage unit 241, and outputs the selected informationto the transmitting-information encoder 239.

[0225] The selected transmitting information is encoded in thetransmitting-information encoder 239, and is then distributed to theclient 220 from the transmitter/receiver 232.

[0226] The content distribution server 230 may bill for an informationusage fee different from the content usage fee when sending the averageddigest or the personal digest. This accounting processing may beperformed by the accounting server 250 on the network.

[0227]FIG. 23 is a flow chart illustrating the processing performed bythe client 220 and the content distribution server 230. In practice,this processing is implemented by a cooperative operation of the CPU 226of the client 220 and the CPU 231 of the content distribution server230. The overall processing performed by the client 220 and the server230 is described below with reference to the flow chart of FIG. 23.

[0228] In steps S101 and S111, content information is sent and receivedbetween the client 220 and the content distribution server 230. Morespecifically, in the content distribution server 230, in step S111, thecontent is extracted from the content-information storage unit 240, andis then subjected to predetermined processing in thetransmitting-information encoder 239. The content is then transmittedfrom the transmitter/receiver 232. The content to be distributed istime-based information, such as a movie, a drama, or a sport program.Alternatively, it may be a broadcast program distributed from apredetermined broadcast program.

[0229] In the client 220, in step S102, the received content issubjected to predetermined decoding processing in thereceived-information decoder 222, and is provided on the informationprovider 223, such as a display unit and a microphone.

[0230] While the content is being provided, in step S103, the user ofthe client 220 inputs user favorite information, such as an interestingscene, an uninteresting scene, or a scene that the user wishes to watchvia the information providing interface 224. The input user favoriteinformation is used as material data for generating the content digestinformation in the content distribution server 230. The user is able tospatially or temporally specify the scene by using the informationproviding interface 224. The input user favorite information (forexample, an interesting scene) is subjected to predetermined encodingprocessing in the transmitting-information encoder 225, and is thentransmitted to the content distribution server 230 via thetransmitter/receiver 221.

[0231] In the content distribution server 230, in step S112, the userfavorite information is received by the transmitter/receiver 232. Then,in step S113, the received favorite information is subjected topredetermined decoding processing in the received-information decoder233, and is stored in the favorite-information storage unit 234. Then,the averaged-digest creator 236 extracts the favorite informationcollected from the individual clients from the favorite-informationstorage unit 234, and performs statistical processing so as to create anaveraged digest of the corresponding content stored in thecontent-information storage unit 240. The created averaged digest isstored in the averaged-digest storage unit 242. Details of theaveraged-digest creation processing are described below.

[0232] In the client 220, it is determined in step S104 whether the userhas made a request to send a personal digest. In step S105, the requestis encoded in the transmitting-information encoder 225, and is then sentto the content distribution server 230. When sending the personal digestrequest, personal user information may be contained in the request.

[0233] In step S114, the content distribution server 230 receives thepersonal digest request. Then, in step S116, a personal digest iscreated. More specifically, by utilizing the user favorite informationstored in the favorite-information storage unit 234 and the averageddigest stored in the averaged-digest storage unit 242, thepersonal-digest creator 237 creates the personal digest reflecting thefavorites of the requested user from the difference between the favoriteinformation input from the requested user and the averaged digest.Details of the personal-digest creation processing are discussed below.

[0234] In step S117, the created personal digest is subjected topredetermined encoding processing in the transmitting-informationencoder 239, and is then sent to the requested client 220 by thetransmitter/receiver 232. The digest may be formed of a combination ofthe corresponding scenes or frames in the content, or may be indexinformation for extracting these scenes or frames from the content. Thecontent distribution server 230 may bill for an information usage feedifferent from the content usage fee when sending the personal digest.This accounting processing may be performed by the accounting server 250on the network.

[0235] In the client 220, in step S106, the personal digest is receivedby the transmitter/receiver 221. Then, in step S107, the personal digestis subjected to predetermined decoding processing in thereceived-information decoder 222, and is provided on the informationprovider 223, such as a monitor display unit.

[0236] The personal digest reflects more personal favorites than theaveraged digest. Accordingly, the user who has received the personaldigest is able to more efficiently identify the value or the attractionof the content from a personal point of view. This becomes a strongincentive to the viewers to return the user favorite information, whichis used as material data for generating a digest, to the contentdistribution server 230.

[0237]FIG. 24 is a flow chart illustrating the processing for creatingthe averaged digest in the content distribution server 230. In practice,this processing is implemented by a cooperative operation of the CPU 231and the averaged-digest creator 236 of the content distribution server230. The averaged-digest creation processing is described below withreference to the flow chart of FIG. 24.

[0238] The favorite information collected from the individual users,i.e., the clients 220, is stored in the favorite-information storageunit 234. In step S121, the averaged-digest creator 236 extracts thefavorite scene information of the individual users from thefavorite-information storage unit 234.

[0239] The favorite scene information is not uniformly arranged in thetime-space domain, but is distributed non-uniformly according to theusers' interests. Thus, in step S122, the portions, i.e., the scenes,which are frequency designated in the time-space domain are extractedand combined, thereby forming an averaged digest. More specifically, instep S122, the averaged-digest creator 236 determines the total digesttime in advance. Then, the averaged-digest creator 236 sorts the scenesin the order of the scenes which are specified by a greater number ofusers, and extracts the scenes from the top. In step S123, the extractedscenes are sequentially added as the digest scenes. It is determined instep S124 whether the total digest time has been reached. If the outcomeof step S124 is no, the processing in step S123 is repeated until thetotal digest time has been reached.

[0240] If the outcome of step S124 is yes, the process proceeds to stepS125 in which the averaged digest is output and stored in theaveraged-digest storage unit 242.

[0241]FIG. 25 is a flow chart illustrating the processing for creating apersonal digest in the content distribution server 230. In practice,this processing is implemented by a cooperative operation of the CPU 231and the personal digest creator 237 of the content distribution server230. The personal-digest creation processing is described below withreference to the flow chart of FIG. 25.

[0242] The favorite information collected from the individual users,i.e., the clients 220, is stored in the favorite-information storageunit 234. In step S131, the personal-digest creator 237 extractsfavorite scene information of a specific user (who has sent apersonal-digest transmission request) from the favorite-informationstorage unit 234.

[0243] Then, in step S132, the personal-digest creator 237 extracts theaveraged digest from the averaged-digest storage unit 242.

[0244] Then, in step S133, the personal-digest creator 237 compares thefavorite information of the requester with the averaged digest. The userfavorite information has portions which overlap with the averaged digestand portions which do not overlap therewith according to the individualinterests. In step S134, the personal-digest creator 237 extracts theportions unique to the user favorite information, which reflect adifference of favorites between the requester and the other users. Then,in step S135, the extracted portions are added to the personal digest.

[0245] It is then determined in step S136 whether the total digest timehas been reached. If the result of step S136 is no, the process returnsto step S138 in which a determination is made as to whether there areremaining scenes unique to the user favorite information of therequester. If the outcome of step S138 is yes, the process proceeds tostep S133 in which the processing in steps S133 through S136 isrepeated. If the result of step S138 is no, the process proceeds to stepS139 in which scenes are suitably-extracted from the averaged digest.Then, in step S135, the extracted scenes are added to the personaldigest.

[0246] If it is found in step S136 that the total digest time has beenreached, in step S137, the personal-digest creator 237 outputs thepersonal data and is stored in the personal-digest storage unit 241.

[0247] According to the above-described embodiment, in the networksystem 210 for providing information of a time-based event, such as asport program or a drama, many pieces of favorite information from aplurality of content viewers are collected and averaged, therebycreating an averaged digest as part of the content digest information.This averaged digest may be sold to the users who have not viewed thecontent. Such users are able to estimate the value and the attraction ofthe content based on the averaged digest.

[0248] In this embodiment, a personal digest reflecting more personalfavorites can also be created as part of the content digest informationfrom the difference between the favorite information sent from aspecific user and the averaged digest. This personal digest can beprovided as a return to the viewers who have provided the favoriteinformation. This can be an incentive to the users to provide favoriteinformation required for generating the averaged digest to the contentdistribution server 230.

[0249]FIG. 26 is a schematic diagram illustrating the configuration of acontent distribution system 300 according to a further embodiment of thepresent invention. The content distribution system 300 includes: asshown in FIG. 26, a content providing apparatus (a broadcast station ora server) 310 for providing content via a predeterminedbroadcast/communication channel 301; at least one content receivingapparatus 350 for receiving the content from the content providingapparatus 310; and at least one receiving terminal 380 which isconnected to the content receiving apparatus 350 via a predeterminedbroadcast/communication channel 302 and which receives predeterminedinformation from the content receiving apparatus 350.

[0250] The content receiving apparatus 350 is formed of, for example, atelevision receiver or a set-top box (STB). The content receivingapparatus 350 stores the content received from the external contentproviding apparatus 310, plays back the content by, for example,displaying the content or outputting the sound, and controls the inputfrom a user (for example, play, fast-forward, pause, or rewind). Thecontent receiving apparatus 350 also creates a digest edition of thereceived content or the stored content, and stores the created digestedition.

[0251] In the content receiving apparatus 350, information concerning,for example, the priority and the emergency of the content, may be addedto the created digest edition. The data may also be formed into ahierarchical structure consisting of a plurality of data groups havingdifferent degrees of digesting. The created and stored digest can betransmitted to the external receiving terminal 380.

[0252] The receiving terminal 380 is formed of, for example, a smallportable information terminal, such as a personal digital assistant(PDA), or a desk-top or notebook personal computer (PC). The receivingterminal 380 receives the processed data of the content, such as adigest edition, from the content receiving apparatus 350, and displaysit on a display unit, such as a viewer, plays it back by, for example,displaying it or outputting the sound, controls the input from a user(for example, play, fast-forward, pause, or rewind).

[0253]FIG. 27 is a schematic block diagram illustrating the functionalconfiguration of the content receiving apparatus 350 according to thisembodiment. The content receiving apparatus 350 includes, as shown inFIG. 27, an encoder/transmitter 351 for sending data to the contentproviding apparatus 310, a receiver/decoder 352 for receiving data fromthe content providing apparatus 310 (interface protocols in thebroadcast/communication channel 301 are implemented by theencoder/transmitter 351 and the receiver/decoder 352), anencoder/transmitter 353 for sending data to the receiving terminal 380,a receiver/decoder 354 for receiving data from the receiving terminal380, a controller 355, a control input unit 356 for receiving useroperations, a data storage unit 357, a display output unit 358, and adigesting unit 359.

[0254] Under the overall control of the controller 355, the contentreceiving apparatus 350 digests the content supplied from the contentproviding apparatus 310, and performs various types of processing, suchas providing services for delivering or distributing the created digestto an external terminal. In FIG. 27, the solid arrows indicate the flowof the content and the digest information, while the broken arrowsrepresent the flow of signals for controlling the flow of theabove-described data.

[0255] The content receiving apparatus 350 is able to request thecontent providing apparatus 310 to provide the content. In this case,under the overall control of the controller 355, the encoder/transmitter351 encodes a content transmission request and sends it to the contentproviding apparatus 310.

[0256] The content provided from the content providing apparatus 310 viabroadcast or communication means is decoded by the receiver/decoder 352,and is then stored in the data storage unit 357.

[0257] The content decoded by the receiver/decoder 352 is also output tothe display output unit 358, such as a display device or a microphone,and is provided to the user. Alternatively, the content may betemporarily stored in the data storage unit 357, and may be played backon the display output unit 358.

[0258] The content decoded by the receiver/decoder 352 is also output tothe digesting unit 359, and a digest edition is created. The digestedition may be any one of a dynamic digest, an averaged digest, and apersonal digest described above, and corresponds to the content digestinformation of the present invention. Details of the digestingprocessing are described below. The created digest is stored in the datastorage unit 357.

[0259] The receiving terminal 380, such as a portable device, forexample, a PDA, is able to request the content receiving apparatus 350to send the received content or a digest thereof. This transmissionrequest is received and decoded by the receiver/decoder 354. In thiscase, under the overall control of the controller 355, the requestedcontent or a digest thereof is extracted from the data storage unit 357,and is encoded by the encoder/transmitter 353, and is then transmittedto the receiving terminal 380. When sending the digest, the contentreceiving apparatus 350 may bill for an information usage fee differentfrom the content usage fee. This accounting processing may be executedby an accounting server (not shown).

[0260] When sending a digesting request to the content receivingapparatus 350, the receiving terminal 380 may attach content processinginformation (for example, personal user information) which designatesthe digesting standards or technique. Then, based on the contentprocessing information, the content receiving apparatus 350 may createthe digest information of the stored content.

[0261]FIG. 28 is a flow chart illustrating the content digestingprocessing executed by the content receiving apparatus 350. In practice,this processing is implemented by executing a predetermined program codeby the controller 355. The content digesting processing is discussedbelow with reference to the flow chart of FIG. 28.

[0262] The content is distributed from the content providing apparatus310 to the content receiving apparatus 350 via thebroadcast/communication channel 301. It is first determined in step S141whether there is a request to store content data. If the outcome of stepS141 is yes, the controller 355 determines in step S142 whether there isa request to digest the content from the receiving terminal 380.

[0263] If the result of step S142 is yes, in step S143, the processinginformation required for digesting the content is received from thereceiving terminal 380. Then, in step S144, an image-based digest sceneis created by the digesting unit 359, and index information is added tothe image-based digest scene and is stored in the data storage unit 357.In step S145, the digesting unit 359 also creates text-based digestdata, and index information is added to the text-based digest data andis stored in the data storage unit 357.

[0264] In step S146, the digesting unit 359 forms the digest scene/datainto a hierarchical structure according to, for example, the frequencyof occurrence of requests, and attaches the index information to thehierarchical digest scene/data. The resulting digest scene/data is thenstored in the data storage unit 357. The digesting degree is differentaccording to the level of the hierarchical structure. In thisembodiment, a higher level of the hierarchical structure has a smalleramount of data, i.e., a smaller data size.

[0265] It is then determined in step S147 whether the data storage iscompleted. If the outcome of step S147 is yes, the content digestingprocessing is completed. If the result of step S147 is no, the processreturns to step S142, and the corresponding processing is repeated.

[0266] Then, in step S148, the priority and the urgency of the contentare determined by the controller 355. If it is found in step S148 thatthe content has a high priority or urgency, in step S149, the content isurgently transmitted under the control of the controller 355.

[0267] Then, it is determined in step S150 whether it is necessary tosend a completion report. If the outcome of step S150 is yes, in stepS151, a completion report is sent.

[0268] A determination is then made in step S152 as to whether atransmission request has been made from the receiving terminal 380. Ifthe result of step S152 is yes, in step S153, the requested content or adigest thereof is sent to the receiving terminal 380.

[0269] The transmission services of the content or the digest may becharged to the receiving terminal 380. In this case, the accountingprocessing may be performed by an accounting server (not shown). Thecontent receiving apparatus 350 may automatically select the digest dataof a suitable level according to the accounting status of the user orthe transmission rate of the broadcast/communication channel 302, andtransfers the selected digest data to the receiving terminal 380.

[0270] Upon receiving the content or a digest thereof, the receivingterminal 380 is now able to play back the content or the digest. If thereceiving terminal 380 has a limited storage capacity or computationperformance, such as a small terminal device, for example, a PDA, it canobtain a relatively small digest edition so as to display it undermobile environments.

[0271] The content digest processing according to this embodiment isdiscussed below by using a baseball broadcast program as an example ofthe content.

[0272] It is now assumed that an instruction to store the content of abaseball broadcast program has been provided from the content receivingapparatus 350 or the receiving terminal 380, and that an instruction todigest the content is simultaneously provided.

[0273] When a baseball broadcast time is started, the content receivingapparatus 350 starts to store the broadcast program. If there is a scenein which a score is obtained, the corresponding scene is automaticallyextracted and stored separately from the main baseball broadcastedition. Alternatively, an interview of a user's favorite team isstored. Not only the video data, but also data of a score-bookindicating the progress of a game, and the results or the progress ofother games are extracted and stored. Additionally, auxiliary datarelated to the main broadcast program (for example, an electronicprogram guide (EPG)) may be extracted and stored.

[0274] The broadcast data itself is positioned at the lowest levelhaving the highest amount of information of the hierarchical structure.The scoring scene is positioned at a higher level having a smalleramount of information. Among the scoring scenes, a home-run scene or ascoring scene of a user's favorite team is positioned at a higher levelhaving a smaller amount of information. Compared to the score-book,scenes related to a hitter, a runner, a pitcher, or a score extractedfrom the score-book is positioned at a higher level. Informationconcerning a final score, a winner/loser pitcher, or a hitter who hashit a home-run may be positioned at an even higher level having asmaller amount of information. For facilitating the search, which is tobe executed later, index information is attached to the data of theindividual levels, and the resulting data is stored in the data storageunit 357.

[0275] Upon completing the broadcast of the program, the data storageprocessing for the broadcast content is also finished. The content mayurgently be transmitted to the receiving terminal 380 only when a user'sfavorite team has won, in which case, only the results of the game maybe sent. A storage completion report may also be sent to the receivingterminal 380.

[0276] Thereafter, when the user has time while being away or on the wayhome, the user requests the receiving apparatus 350 to send theinformation of the progress of the game by using the receiving terminal380, such as a PDA. The receiving apparatus 350 then sends the data at ahigher level having a relatively smaller amount of information, such asa home-run scene or a game progress list, according to the traffic ofthe communication channel. Then, after going home, the user is able toenjoy the entire baseball broadcast program or favorite scenes by usingthe content receiving apparatus 350.

[0277] The above-described content distribution processing and thevalue-added information creation processing of the foregoing embodimentsof the present invention may be implemented by a special hardwaredevice. Alternatively, such processing may be implemented by executingpredetermined software programs (for example, program codes indicated bythe flow charts of FIGS. 3, 4, 8, 9, 10, 16, 17, 20, 23, 24, 25, and 28)by using a general-purpose computer system.

[0278]FIG. 29 is a schematic block diagram illustrating theconfiguration of a computer system 500 to which the present invention isapplied. A description is given below, with reference to FIG. 29, of thefunctional configuration of the computer system 500 for executing theprogram codes indicated by the flow charts of FIGS. 3, 4, 8, 9, 10, 16,17, 20, 23, 24, 25, and 28.

[0279] A CPU 501, which serves as a main controller of the computersystem 500, runs various applications under the control of an operatingsystem (OS). As shown in FIG. 29, the CPU 501 is connected to the otherdevices (described below) via a bus 508.

[0280] A memory 502 stores program codes executed by the CPU 501, andtemporarily stores work data which is being executed. It is to beunderstood that the memory 502 includes non-volatile and volatile memorydevices.

[0281] A display controller 503 is a special controller for processingrendering commands issued by the CPU 501. The rendering data processedby the display controller 503 is temporarily written into, for example,a frame buffer (not shown), and is output to a display unit 511.

[0282] An input-device interface 504 is a device for connecting a userinput device, such as, a keyboard 512 or a mouse 513, to the computersystem 500.

[0283] A network interface 505 is able to connect the computer system500 to a local network, such as a LAN, or a wide network, such as theInternet, according to a predetermined communication protocol, such asthe Ethernet.

[0284] On the network, a plurality of host terminals (not shown), suchas content receiving apparatuses, are connected to each other whilebeing transparent to each other, thereby constructing a distributedcomputing environment. Software programs and data content can bedistributed on the network. For example, application programs forperforming the content distribution processing and the content digestinformation creation processing according to the foregoing embodimentsof the present invention can be downloaded via the network. It is alsopossible to receive user favorite information and instructioninformation input by using the individual content receiving apparatuseson the network, and to distribute the content value-added informationand the content digest, which are generated based on the favoriteinformation and the instruction information, to the content receivingapparatuses via the network.

[0285] A content transmitting interface 506 is a device for transmittingthe content by superimposing it on broadcast waves of a predeterminedchannel. However, if the content is distributed via a network or amedium, such as a DVD, it is not necessary to use the contenttransmitting interface 506.

[0286] An external-device interface 507 is a device for connecting anexternal device, such as a hard disk drive (HDD) 514 or a media drive515, to the computer system 500.

[0287] The HDD 514 is a known device in which a magnetic disk, whichserves as a storage carrier, is fixed, and exhibits superiorcharacteristics than the other external storage devices in light of thestorage capacity and the transfer rate. To place a software program onthe HDD 514 so that it can be executed is to “install” the program intothe system. Generally, program codes of the OS executed by the CPU 501,application programs, and device drivers are stored in the HDD 514.These data are retained even if the computer system 500 is powered off.

[0288] For example, applications for performing the content distributionprocessing and the content value-added information/digest informationcreation processing according to the above-described embodiments of thepresent invention can be installed in the HDD 514. The distributioncontent and the user favorite information/instruction informationreceived via a network can be stored in the HDD 514. The contentvalue-added information/digest information generated based on the userfavorite information/instruction information can also be stored in theHDD 514.

[0289] The media drive 515 is a device for loading a portable medium,such as a compact disc (CD), a magneto-optical disk (MO), or a DVD,thereon, so as to access the data recording surface of such a portablemedium.

[0290] The portable media are used for backing up software programs anddata files in the computer readable format, and are also used fortransferring such programs and files between systems (i.e. sales,distribution, and delivering of the programs and files). For example,applications for the content distribution processing and the value-addedinformation/digest information creation processing can be physicallydistributed or transferred among a plurality of devices by using theseportable devices. The content value-added information and the digestinformation generated based on the user favorite information andinstruction information can be physically distributed or transferredamong a plurality of devices by using these portable devices.

[0291] An example of the computer system 500 shown in FIG. 29 is a PC/AT(personal computer/advanced technology) compatible machine (IBMCorporation in the United States) or a succeeding model thereof.Alternatively, a computer based on another architecture may be used asthe computer system 500.

[0292] While the present invention has been described with reference towhat are presently considered to be the preferred embodiments, it is tobe understood that the invention is not limited to the disclosedembodiments. On the contrary, the invention is intended to cover variousmodifications and equivalent arrangements included within the spirit andscope of the appended claims. The scope of the following claims is to beaccorded the broadest interpretation so as to encompass all suchmodifications and equivalent structures and functions.

What is claimed is:
 1. A communication apparatus comprising: receivingmeans for receiving operation data obtained by each user for dynamicdata played back by a playback apparatus; storage means for storing theoperation data received by said receiving means; digest-informationgenerating means for generating digest information of the dynamic dataaccording to the operation data stored in said storage means; andtransmission means for transmitting the digest information generated bysaid digest-information generating means to at least one of the playbackapparatuses.
 2. A communication apparatus according to claim 1, whereinsaid receiving means receives the operation data indicating at least oneof instructions to fast-forward, rewind, and pause the dynamic dataplayed back by the playback apparatus.
 3. A communication apparatusaccording to claim 1, wherein: said receiving means receivesplayback-portion identification information indicating a playbackportion of the dynamic data played back by the playback apparatus; andsaid digest-information generating means comprises statisticalprocessing means for accumulating playback times of the playback portionbased on the playback-portion identification information received bysaid receiving means, and generates the digest information based on anaccumulation result obtained by said statistical processing means.
 4. Acommunication apparatus according to claim 3, wherein saiddigest-information generating means generates the digest informationfrom the playback portion whose accumulated playback times indicate apredetermined threshold or greater.
 5. A communication apparatusaccording to claim 3, wherein said digest-information generating meansgenerates the digest information from the portions other than theplayback portion whose accumulated playback times indicate apredetermined threshold or smaller.
 6. A communication apparatusaccording to claim 3, wherein said receiving means receives, togetherwith the operation data, at least one of title information, playbacktime information, and user attribute information of the dynamic dataplayed back by the playback apparatus.
 7. A communication apparatusaccording to claim 6, wherein: said storage means stores the operationdata of a plurality of users corresponding to the title information;said statistical processing means accumulates the playback times of theplayback portion according to the title information based on theoperation data of the plurality of users; said digest-informationgenerating means generates the digest information based on theaccumulation result; and said transmission means transmits the digestinformation to the playback apparatus for playing back the titleinformation.
 8. A communication apparatus according to claim 7, whereinthe user attribute information includes at least one type of the age,the gender, and the life-style, and said digest-information generatingmeans generates the digest information according to the type of the userattribute information.
 9. A communication apparatus according to claim1, wherein said receiving means receives as the operation datatime-space position data designating a time-space position of thedynamic data played back by the playback apparatus.
 10. A communicationapparatus according to claim 9, wherein: said storage means stores aplurality of the dynamic data; and said transmission means encodes thedynamic data and transmits the encoded dynamic data to the playbackapparatus in response to a request from the user, in which saidtransmission means encodes a target area designated by the time-spaceposition data at a first resolution level, and encodes areas other thanthe target area at a second resolution level which is lower than thefirst resolution level.
 11. A communication apparatus according to claim1, wherein: said transmission means transmits predetermined dynamic datato the playback apparatus in response to a request from the user: saidreceiving means receives the operation data obtained by each user forthe dynamic data transmitted by said transmission means; saiddigest-information generating means generates the digest information ofthe dynamic data according to the operation data; and said transmissionmeans transmits the generated digest information to the correspondingplayback apparatus in response to a request from the user.
 12. Acommunication apparatus according to claim 11, wherein said transmissionmeans comprises broadcast means for broadcasting the dynamic data to theplayback apparatuses of unspecified users.
 13. A communication apparatusaccording to claim 11, wherein said receiving means receives as theoperation data time-space position data designating a time-spaceposition of the dynamic data transmitted by said transmission means andplayed back by the playback apparatus.
 14. A communication apparatusaccording to claim 13, wherein said transmission means encodes thedynamic data and transmits the encoded dynamic data to the playbackapparatus in response to a request from the user, in which saidtransmission means encodes a target area designated by the time-spaceposition data at a first resolution level, and encodes areas other thanthe target area at a second resolution level which is lower than thefirst resolution level, and transmits the encoded dynamic data.
 15. Acommunication apparatus according to claim 14, wherein saiddigest-information generating means comprises statistical processingmeans for accumulating designation times of each of the time-spacepositions based on the time-space position data of the identical dynamicdata received from a plurality of users by said receiving means, andgenerates the digest information based on an accumulation resultobtained by said statistical processing means.
 16. A communicationapparatus according to claim 15, wherein said digest-informationgenerating means dynamically sorts the accumulation results of scenesdesignated by the time-space position data obtained by said statisticalprocessing means in descending numeric order, and extracts apredetermined number of scenes having a greater number of theaccumulated designation times according to a sorting result, therebydynamically generating the digest information.
 17. A communicationapparatus according to claim 16, wherein: said transmission meanscomprises broadcast means for broadcasting the dynamic data to theplayback apparatuses of unspecified users; when said receiving meansreceives request information to send the digest information from theplayback apparatus while the dynamic data is being broadcast, saiddigest-information generating means generates the digest informationduring a period from when the dynamic data is started until when thedigest information is transmitted; and said transmission means transmitsthe digest information to the playback apparatus.
 18. A communicationapparatus according to claim 16, wherein: when said receiving meansreceives request information to send the digest information from aspecific playback apparatus, said digest-information generating meanscompares the digest information generated based on the sorting resultwith the scenes designated by the time-space position data of the userof the specific playback apparatus, and preferentially selects thescenes unique to the time-space position data of the user, therebygenerating new digest information for the user.
 19. A communicationapparatus according to claim 1, wherein said transmission meanstransmits the digest information to the playback apparatus of the user,and also transmits accounting information including payment informationfor billing the user to an external settlement center.
 20. Acommunication apparatus comprising: playback means for playing backdynamic data; input means for inputting as input data user favorite datafor the dynamic data played back by said playback means; transmissionmeans for transmitting the input data input by said input means to anexternal communication apparatus; and receiving means for receivingdigest information of the dynamic data transmitted from said externalcommunication apparatus.
 21. A communication apparatus according toclaim 20, wherein said input means outputs the input data indicating atleast one of instructions to fast-forward, rewind, and pause the dynamicdata played back by said playback means.
 22. A communication apparatusaccording to claim 20, wherein said transmission means transmitsplayback-portion identification information indicating a playbackportion of the dynamic data played back by said playback means.
 23. Acommunication apparatus according to claim 22, wherein said transmissionmeans transmits, together with the input data, at least one of titleinformation, playback time information, and user attribute informationof the dynamic data played back by said playback means.
 24. Acommunication apparatus according to claim 20, wherein: said input meansoutputs as the input data time-space position data designating atime-space position of the dynamic data played back by said playbackmeans; and said transmission means transmits the time-space positiondata.
 25. A communication apparatus according to claim 20, wherein: saidtransmission means transmits request information to send predetermineddynamic data to said external communication apparatus; said receivingmeans receives the dynamic data transmitted from said externalcommunication apparatus in response to the request information; and saidplayback means plays back the received dynamic data.
 26. A communicationapparatus according to claim 25, wherein said receiving means comprisesbroadcast receiving means for receiving the dynamic data to be broadcastto said playback means of unspecified users.
 27. A communicationapparatus according to claim 25, wherein said transmission meanstransmits as the input data time-space position data designating atime-space position of the dynamic data received by said receiving meansand played back by said playback means.
 28. A communication apparatusaccording to claim 26, wherein said transmission means transmits therequest information to send the digest information during a period fromthe start of the dynamic data until a current time while the dynamicdata is being played back by said playback means.
 29. A communicationapparatus comprising: receiving means for receiving dynamic data from anexternal source; playback means for playing back the dynamic datareceived by said receiving means; input means for inputting as inputdata user favorite data for the dynamic data played back by saidplayback means; digest-information generating means for generatingdigest information based on the input data input by said input means;and transmission means for transmitting the digest information generatedby said digest-information generating means to a portable terminal. 30.A communication apparatus according to claim 29, wherein said inputmeans outputs input data indicating at least one of instructions tofast-forward, rewind, and pause the dynamic data played back by saidplayback means.
 31. A communication apparatus according to claim 29,wherein: said input means outputs as the input data playback-portionidentification information indicating a playback portion of the dynamicdata played back by said playback means; and said digest-informationgenerating means comprises statistical processing means for accumulatingplayback times of the playback portion based on the playback-portionidentification information, and generates the digest information basedon an accumulation result obtained by said statistical processing means.32. A communication apparatus according to claim 31, wherein saiddigest-information generating means generates the digest informationfrom the playback portion whose accumulated playback times indicate apredetermined threshold or greater.
 33. A communication apparatusaccording to claim 31, wherein said digest-information generating meansgenerates the digest information from portions other than the playbackportion whose accumulated playback times indicate a predeterminedthreshold or smaller.
 34. A communication apparatus according to claim31, wherein said input means outputs as the input data at least one oftitle information, playback time information, and user attributeinformation of the dynamic data played back by said playback means. 35.A communication apparatus according to claim 34, further comprisingstorage means for storing the operation data of a plurality of userscorresponding to the title information, wherein: said statisticalprocessing means accumulates the playback times of each of the playbackportions according to the title information based on the operation dataof the plurality of users; and said digest-information generating meansgenerates the digest information based on the accumulation result.
 36. Acommunication apparatus according to claim 35, wherein the userattribute information includes at least one type of the age, the gender,and the life-style, and said digest-information generating meansgenerates the digest information according to the type of the userattribute information.
 37. A communication apparatus according to claim29, wherein said input means outputs as the input data time-spaceposition data designating a time-space position of the dynamic dataplayed back said playback means.
 38. A communication apparatus accordingto claim 29, wherein: said transmission means transmits requestinformation to send predetermined dynamic data to an externalcommunication apparatus; said receiving means receives the dynamic datatransmitted from said external communication apparatus in response tothe request information; and said digest-information generating meansgenerates the digest information of the dynamic data.
 39. Acommunication apparatus according to claim 29, wherein said receivingmeans comprises broadcast receiving means for receiving the dynamic datato be broadcast to said playback means of unspecified users.
 40. Acommunication apparatus according to claim 39, wherein said input meansoutputs as the input data time-space position data designating atime-space position of the dynamic data received by said broadcastreceiving means and played back by said playback means.
 41. Acommunication apparatus according to claim 40, wherein saiddigest-information generating means comprises statistical processingmeans for accumulating designation times of each of the time-spacepositions based on the time-space position data of the identical dynamicdata input by said input means, and generates the digest informationbased on an accumulation result obtained by said statistical processingmeans.
 42. A communication apparatus according to claim 41, wherein saiddigest-information generating means dynamically sorts the accumulationresults of scenes designated by the time-space position data obtained bysaid statistical processing means in descending numeric order, andextracts a predetermined number of scenes having a greater number of theaccumulated designation times according to a sorting result, therebydynamically generating the digest information.
 43. A communicationapparatus according to claim 42, wherein, when said input means outputsrequest information to send the digest information from said playbackmeans while the dynamic data is being broadcast, said digest-informationgenerating means generates the digest information during a period fromwhen the dynamic data is started until when the digest information istransmitted.
 44. A communication apparatus according to claim 42,wherein, when said input means outputs request information to send thedigest information from a specific user, said digest-informationgenerating means compares the digest information generated based on thesorting result with the scenes designated by the time-space positiondata of the specific user, and preferentially selects the scenes uniqueto the time-space position data of the specific user, thereby generatingnew digest information for the specific user.
 45. A communicationapparatus according to claim 29, wherein said transmission meanspreferentially transmits the digest information to said portableterminal according to the level of priority or the level of urgency ofthe digest information.
 46. A communication apparatus according to claim29, wherein said digest-information generating means generates thedigest information in a hierarchical structure consisting of layershaving different sizes of the digest information, in which a lower layerof the hierarchical structure has a greater size of the digestinformation, and a higher layer of the hierarchical structure has asmaller size of the digest information.
 47. A communication apparatusaccording to claim 46, wherein said digest-information generating meansselectively transmits the digest information of the individual levels ofthe hierarchical structure according to a traffic of a communicationchannel between said communication apparatus and said portable terminal.48. A communication apparatus according to claim 29, wherein saidplayback means comprises display means for displaying moving picturedata, which serves as the dynamic data or the digest information.
 49. Acommunication method comprising the steps of: receiving operation dataobtained by each user for dynamic data played back by a playbackapparatus; generating digest information of the dynamic data accordingto the received operation data; and transmitting the generated digestinformation to at least one of the playback apparatuses.
 50. Acommunication method comprising the steps of: playing back dynamic data;inputting as input data user favorite data for the played back dynamicdata; transmitting the input data to an external communicationapparatus; and receiving digest information of the dynamic datatransmitted from said external communication apparatus.
 51. Acommunication method comprising: receiving dynamic data from an externalsource; playing back the received dynamic data; inputting as input datauser favorite data for the played back dynamic data; generating digestinformation based on the input data; and transmitting the generateddigest information to a portable terminal.
 52. A storage medium forstoring a program implementing a communication method, saidcommunication method comprising the steps of: receiving operation dataobtained by each user for dynamic data played back by a playbackapparatus; generating digest information of the dynamic data accordingto the received operation data; and transmitting the generated digestinformation to at least one of the playback apparatuses.
 53. A storagemedium for storing a program implementing a communication method, saidcommunication method comprising the steps of: playing back dynamic data;inputting as input data user favorite data for the played back dynamicdata; transmitting the input data to an external communicationapparatus; and receiving digest information of the dynamic datatransmitted from said external communication apparatus.
 54. A storagemedium for storing a program implementing a communication method, saidcommunication method comprising the steps of: receiving dynamic datafrom an external source; playing back the received dynamic data;inputting as input data user favorite data for the played back dynamicdata; generating digest information based on the input data; andtransmitting the generated digest information to a portable terminal.